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I.  INTRODUCTION 

Rapid  advancements  in  the  communication  and  computer  technologies  coupled 
with  today's  need  to  deal  with  more  complex  and  numerous  decision  making  situations 
will  most  likely  result  in  the  widespread  adoption  and  utilization  of  computer-mediated 
communication  systems  in  the  coming  years.  It  is.  therefore,  important  to  understand 
the  impact  of  these  systems  on  decision  making  processes  and,  particularly,  the 
dilTerences  between  computer-mediated  and  face-to-face  interactions,  so  that  the 
systems  may  be  implemented  for  most  efiective  and  efficient  use. 

Some  of  the  more  frequently  expressed  comments  regarding  the  differences 
between  computer-mediated  and  face-to-face  interactions  are: 

•  computerized  mediation  diminishes  the  social  impact  [Refs.  1,2], 

•  managers     are     action-oriented     and     prefer     face-to-face     communications. 
[Refs.^3.4].  and 

•  use  of  computer  mediated  svstems  may  result  in  the  lessening  of  interpersonal 
relationships  and  a  loss  of  the  richness  of  human  interaction. 

On  the  other  hand,  computer-mediated  systems,  especially  those  that  support 

distributed  decision  making,  can  encourage  individual  participation  and  increase  the 

speed  of  communication.    TurofT  and  Hiltz  also  observe  after  testing  the  difierences 

between   face-to-face   and   computer-mediated   systems   (distributed   decision    support 

systems): 


the  nature  of  communication  in  computerized  conferences  devoted  to  decision 
making  tends  to  be  oriented  more  towards  the  achievement  of  quality  decision 
and  less  toward  the  social-emotion  tvpes  of  communications  which  aid 
consensus,  compared  to  face-to-face  conferences.    [Ref.  5:  p.  87] 


Other  works  and  concepts  on  distributed  group  decision  support  systems  include: 
distributed  decision  making  (DDM)  concept  [Refs.  6.7].  distributed  decision  support 
systems  [Ref  8].  computerized  conferencing  systems  [Ref  5].  and  distributed  group 
decision  support  systems  [Ref  9]. 

At  present,  no  research  has  firmly  established  the  superiority  of  one  particular 
concept.  Moreover,  the  context  has  changed;  new  technologies  and  managers'  shifting 
mindset  and  attitudes  toward  using  computers  for  decision  making  may  make  past 
assumptions  irrelevant. 


A.  PURPOSE  OF  THE  STUDY 

This  study  is  based  on  our  belief  that  recent  developments  in  the  communication 
and  computer-based  information  systems,  particularly  in  group  decision  support 
systems  (GDSS),  can  increase  the  efficiency  (decision  speed)  and  effectiveness  {decision 
quality)  of  group  decision  making  and  problem  solving  activities.  Decision  support 
tools  have  developed  to  the  point  where  they  can  be  applied  to  these  activities.  Yet.  at 
the  moment,  little  research  exists  to  substantiate  this  belief 

Our  empirical  study  is  an  efTort  to  determine  how  the  use  of  a  GDSS  tool  would 
affect  the  decision  outcome  variables  of  distributed  groups,  where  decision  makers  do 
not  meet  face  to  face,  and  non-distributed  groups,  where  they  interact  face  to  face. 
The  decision  outcome  variables  are  such  measures  as  the  decision  quality,  decision 
speed,  and  group  satisfaction  with  the  decision.  The  tool  is  Co-oP.  Cooperative 
Vlultiple  Criteria  Decision  Making  system,  designed  by  Tung  X.  Bui  of  the  Naval 
Postgraduate  School  [Ref  10]. 

B.  DECISION  MAKING  ENVIRONMENT 

Today's  organizational  environment  is  characterized  by  increasingly  complex  and 
dynamic  decision  making  situations.  More  than  ever  before,  organizations  must  be 
keenly  alert  to  swiftly  changing  conditions  and  be  prepared  to  cope  with  the  turbulence 
generated  by  these  changes.  The  demands  of  multiple  constituencies,  uncertain  market 
opportunities,  strong  international  competitors,  increasing  legal,  social,  and 
environmental  constraints,  and  the  growing  complexity  o[  the  decision  tasks  all 
contribute  enormously  to  growing  uncertainties  in  organizations.  These  uncertainties, 
in  turn,  sorely  test  the  organizations'  ability  to  cope  with  their  environment. 

The  problem  is  further  aggravated  by  the  tremendous  amount  of  information 
available  to  organizations.  Those  within  an  organization  must  be  able  to  collect. 
process,  and  disseminate  relevant  information  as  quickly  as  possible  to  avoid  being 
overwhelmed  by  too  much  information  or  missing  out  on  important  new  developments. 
The  fact  that  we  are  presently  living  in  a  society  in  transit  to  what  Bell  coined  the  post- 
industrial  society  can  only  exacerbate  this  problem  [Ref  11]. 

Survival  in  the  post-industrial  society  would  force  decision  makers  to  make  an 
increasing  number  of  important  decisions  swiftly  and  before  they  have  fully  grasped 
and  understood  the  implications  of  their  decisions.  Yet,  the  nature  o^  the 
organizational  environment  demands  that,  most  of  these  decision  makers  make  their 


decisions  not  alone  but  rather  in  group  meetings  or  based  on  group  inputs.  They  rely 
heavily  on  the  meetings  as  a  way  of  doing  business.  In  fact,  a  large  share  of  a 
m^anager's  time  is  spent  communicating  and  m^eeting  with  peers,  supervisors, 
subordinates,  and  others  inside  and  outside  the  organization  [Refs.  3.12J.  According  to 
various  researchers,  during  a  working  week  middle  managers  spend  approximately  35°o 
of  their  time  in  meetings  while  top  managers  spend  50%  [Ref  13]  or  as  much  as  80°  o 
[Ref  14]  in  meetings. 

C.       PROBLEMS  WITH  GROUPS 

In  the  years  to  come,  decision  makers  will  face  even  stronger  pressure  to 
participate  in  an  ever  increasing  number  of  meetings  to  facilitate  greater  and  faster 
exchange  of  information.  Unfortunately,  many  of  these  meetings  can  be  long  and 
boring  without  accomphshing  much  of  anything  useful.  Due  to  this  awareness  and  a 
genuine  lack  of  time,  decision  makers  will  find  it  more  and  more  difilcult  to  get 
together  for  all  the  necessan.-  and  required  meetings. 

The  difficulties  and  frustrations  of  working  in  groups  are  futher  aggravated  by 
the  inhibiting  factors  present  in  the  interactive  group  decision  making  processes.  Van 
de  Ven  and  Delbecq  [Ref  15:  p.  206]  summarize  the  causes  that  seem  to  produce 
inhibiting  influences  which  reduce  the  performance  of  interacting  groups  as  follows: 

•  A  "focus  efTect"  wiierein  interacting  croups  'Tall  into  a  rut"  and  pursue  a  sinale 
train  of  thought  for  long  periods. 

•  The  "self-weishing"  effect,  wherein  an  individual  will  participate  in  the  group  to 
the  extent  that  he  feels  equally  competent  with  others. 

•  The  fact  that  covert  judsments  are  made  but  are  not  expressed  as  overt 
criticisms. 

•  The  inevitable  presence  within  most  organizational  groups  of  status 
incongruities,  wherein  low-status  participants  may  be  inliibited  and  "go  alons" 
with  opinions  expressed  by  high-status  participants,  even  though  thev'feel  their 
opinions  are  better. 

•  Group  pressures  for  conformitv  and  implied  threat  of  sanctions  from  the  more 
knowledgeable  members. 

•  The  influence  of  dominant  personality-types  upon  the  group. 

•  The  amount  of  time  and  elTort  spent  bv  the  group  to  maintain  itself  As 
orientation  to  maintain  group  interaction  increases,  the  qualitv  of  solutions 
decreases. 

•  A  tendency  to  reach  "speedv  decisions"  before  all  problem  dimensions  have 
been  considered. 

As  a  result  of  these  inhibiting  factors,  individuals  participating  in  meetings  may 

not  fully  utilize  their  personal  knowledge  and  resources  to  eflectively  and  efficiently 

solve  the  problems  at  hand. 
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D.       NEED  FOR  COMPUTERIZED  SUPPORT 

Organizations  should  carefully  consider  the  developments  in  communication  and 
computer-based  information  systems  that  would  boost  the  efilciency  and  elTectiveness 
of  group  decision  making  processes.    Huber  writes: 

given  the  apparent  need  for  more  decision-sroup  meetings  and  at  the  same  time  a 
considerable  resistance  to  them,  we  expecf  post-mdustrlal  organizations  to  seek 
and  adapt  on  a^  widespread  basis  more  sophisticated  group  tecTmologies.  and  that 
as  result  the  elTectivehess  of  decision  groups  will  increase.    [Ref  16:  p.  937J 

The  need  for  computerized  support  for  organizational  decision  making  has  been 
recognized  for  some  years.  However,  it  is  only  after  two  major  breakthroughs  in  the 
computer-based  systems  that  organizations  have  been  fully  able  to  appreciate  the 
power  and  utility  of  computers  and  their  attendant  softwares.  The  two  revolutionarv' 
developments  were:  1)  the  large  variety  of  user  friendly  decision  support  system  tools 
(DSS),  such  as  the  database  management  systems,  spreadsheets,  and  various  other 
decision  support  software  packages  that  can  be  readily  understood  by  non-computer 
experts,  and  2)  the  mass  production  and  commercialization  of  small,  inexpensive 
microcomputers. 

Until  recently,  the  decision  support  tools  have  been  primarily  developed  for 
individual  users  and  not  to  facilitate  groups  decision  making.  However,  researchers 
have  now  begun  to  focus  on  DSSs  that  will  assist  the  decision  makers  in  group 
sittiations.  The  communication  and  computer  technologies  that  have  been  developed 
so  far  to  make  meetings  more  elTective  and  efficient  include:  teleconferencing,  video- 
conferencing, electronic  mail  enhanced  Delphi  studies  [Refs.  17,18],  various  other 
computer-mediated  communication  systems  (for  a  summary  of  these  as  well  as  their 
associated  evaluations,  see  [Ref  19]),  and  group  decision  support  systems.  The  focus 
of  our  studv  is  on  the  last  technoloev. 


II 


II.  GROUP  DECISION  SUPPORT  SYSTEMS 

A.       DEFINITION  OF  THE  GDSS 

Group  decision  support  systems  (GDSS)  can  be  defined  quite  broadly,  depending 
on  the  intent  of  the  individual  deisigners. 

•  Bui  and  Jarke  write:  "A  eroup  DSS  can  be  defined  as  a  computer-based  svstem 
that  aims  at  supporting  collective  problem  solving."   [Ref  20:  p.  82] 

•  Huber  states:  "A  GDSS  consists  of  a  set  of  software,  hardware,  and  languaee 
components  and  procedures  that  support  a  group  of  people  engaged"  in  "a 
decision-related  meeting."    [Ref  21:  p.  1V5] 

•  Turoff  and  Kiltz  (Nominal  Group  Technique  GDSS)  suggest  that  decision 
support  svstems  (DSS)  embedded  within  computerized  conferencing  systems  can 
serve  as  tlie  eroup  decision  support  svstem.  This  can  also  be  referred  to  as  the 
distributed  decision  support  system.    [Ref  5] 

•  DeSanctis  and  Gallupe  state:  "A  eroup  decision  support  svstem  (GDSS)  is  an 
interactive  computer-based  svstenrwhich  facilitates  the  solution  of  unstructured 
j^roblems  by  a  set  of  decision  makers  working  together  as  a  group."    [Ref  22:  p. 

In  general,  GDSSs  are  computer-based  systems  designed  to  facilitate  the 
interactive  sharing  and  use  of  information  and  to  assist  a  group  of  individuals  involved 
in  solving  semi-structured  and  unstructured  problems. 


B.       CHARACTERISTICS  OF  THE  GDSS 

GDSS  designers  attribute  various  characteristics  to  their  systems.    Some  of  these 

are  [Ref  22:  p.  4]: 

A  GDSS  is  a  speciallv  designed  svstem,  not  merelv  a  reconfiguration  of  alreadv 
existing  system  components'. 

A  GDSS  is  designed  with  the  eoal  of  supporting  groups  of  decision  makers  in 
their  work. 

A  GDSS  is  easy  to  learn  and  easy  to  use. 

A  GDSS  may  be  "specific"  (i.e..  designed  for  one  type  or  class  of  problem)  or 
"general"  (i.e.",  designed  for  a  variety  oT  group  level  organizational  decisions). 

A  GDSS  contains  built-in  mechanisms  which  discourage  the  development  of 
negative  group  behaviors. 

Most  of  the  GDSSs  developed  or  implemented  by  the  various  academic  research 

groups  and  private  industries  reflects  some  or  all  of  the  above  characteristics. 
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C.       COMPONENTS  OF  THE  GDSS 

The  basic  components  of  the  GDSSs  are  hardware,  software,  people,  and 
procedures.  Each  of  these  components  will  be  discussed  in  detail  in  the  following 
pages.  This  discussion  is  primarily  based  on  the  works  of  Gray  [Ref  23],  TurofT  and 
Hiltz  [Ref  5],  Huber  [Ref  21].  and  DeSanctis  and  Gallupe  [Ref  22]. 

1.  Hardware 

Basic  hardware  components  should  include:  a  CPU,  input  output  devices, 
individual  monitors,  and  or  common  viewing  screens  with  graphics  capabilities.  These 
should  be  configured  in  a  manner  that  will  allow  individuals  to  work  independently  of 
other  group  members,  publicly  show  their  work,  and  share  inputs  with  others.  VIore 
sophisticated  systems  may  include  network  capabilities,  modems,  coinmunication  lines 
between  a  desktop  computer  and  the  mainframe,  and  touch  or  voice  communication 
devices. 

2.  Software 

Generally.  GDSS  features  should  include  such  individual  decision  support 
capabilities  as  database  management,  model  management,  specialized  application 
programs,  and  flexible  user  interfaces  with  standard  software  packages.  Some 
sophisticated  systems  will  also  include  high-level  language  capabilities  for  program 
writing  and  interfaces  with  standard  commercial  managerial  level  softwares  (graphics, 
statistical  OR  packages,  spreadsheets,  etc.). 
Basic  GDSS  software  features  are: 

file  creation,  modification,  and  storage, 

word  processing, 

tutorials. 

on-line  help  facilities, 

worksheets,  spreadsheets,  decision  trees,  and  other  means  of  displaying  data, 

state-of-the-art  database  management  that  would  permit  ad  hoc  queries  and 
better  control  of  access  to  databases.   [Ref  22:  p.  5] 

The  group  features,  the  most  distinguishing  software  component  of  the  GDSS 

include: 

•  methods  of  representing  numerically  and  graphically  the  various  viewpoints  of 
the  group  members. 

•  menus  which  prompt  for  user  inputs, 

•  programs  for  agsregatine  the  preferences  of  the  individuals  such  as  voting, 
ranking,  rating,  arid  weighting  schemes, 

•  m.ethods  of  analyzing  prior  group  interactions  and  judgments,  and 
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•      means  of  communicating  data  and  text  between  and  anions  sroup  members. 
[Ret:  22:  p.  4] 

3.  People 

This  component  includes  the  individuals  involved  in  the  decision-making 
process  and  possibly  a  "group  facilitator."  A  facilitator's  role  can  range  from  being  a 
simple  chauReur.  who  operates  the  GDSS  hardware  and  interfaces  with  the  software 
during  the  group  meetings,  to  being  on  call  as  an  advisor  when  the  group  experiences 
diiTiculties.  A  facilitator  may  be  physically  located  within  a  group  member's  office,  in  a 
data  center,  or  in  a  MIS  department. 

4.  Procedures 

Procedures  are  instructions  to  the  group  members  and  facilitator  that  explain 
the  use  and  operation  of  the  system.  Depending  on  the  degree  of  control  desired  and 
intent  of  the  designers,  procedures  may  deal  only  with  the  use  of  hardware  and 
software,  or  may  include  the  specific  group  decision-making  techniques  and  rules  that 
should  be  used  during  group  discussions  and  decision-making  processes. 

D.       COMMUNICATION  COMPONENTS  OF  THE  GDSS 

Three  major  technological  components  are  considered  essential  in  building 
effective  DSSs:  the  dialogue  manager,  data  manager,  and  model  manager  [Ref  24:  p. 
195-27S].  To  this  Bui  and  Jarke  add  the  communication  component  to  expand  the 
DSS  into  a  GDSS  [Ref  20].  The  communication  component  is  critical  to  the  success 
of  the  GDSS,  yet  it  has  often  been  taken  for  granted  or  ignored.  The  communication 
manager  is  utilized  in  distributed  time  and; or  space  settings,  as  well  as  in  non- 
distributed  settings.  In  non-distributed  setting,  communication  links  provide  the  group 
members  with  the  abiUty  to  communicate  privately  to  each  other,  to  send  information 
to  ihe  pubUc  screens,  and  to  access  and  retrieve  information  from  remote  computers  as 
well  as  access  the  mainframe  from  the  microcomputers. 

In  the  post-industrial  society,  the  decision-makers  will  often  be  geographically 
and  organizationally  dispersed  and  "the  dilTuseness  of  influence  on  decisions  will  he 
greater  "  [Ref  16:  p.  936].  This  dispersion  and  dilTuseness.  as  well  as  the  lack  of  time, 
severely  restricts  the  decision-makers'  ability  to  get  together  for  the  necessar\'  meetings. 
For  these  reasons,  any  system  that  qualifies  as  a  GDSS  must  include  the 
communication  component  that  will  support  the  participants  involved  in  both 
distributed  and  non-distributed  decision-making  settings. 
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E.       RESEARCH  ON  GDSS 

There  are  a  number  of  pioneer  GDSSs  developed  or  implemented  by  various 

academic  research  groups  and  private  sector  corporations.    Some  of  these  are  described 

below. 

•  The  Decision  Room  svstem  at  the  Southern  Methodist  University  which  uses  a 
variety  of  public  displav  screens  and  microcompuiers.  Grav  ha's  conducted  a 
series'  of  experiments  '  on  this  svstem  usma  VIBA  students  as  subiects. 
[Refs.  23.25]  .  ^ 


• 


• 


Perceptronics,  Incorporated  uses  a  decision  tree  structure  called  Group  Decision 
Aid.  Steeb  and  Johnston's  experimental  studv  used  a  crisis  scenario  case 
developed  bv  the  CACI.  Inc..  and  an  intermedia'tor  facilitator  who  acted  as  an 
mtermediar}'  between  the  system  and  the  group  members.   [Ref  26] 

EIES  (Electronic  Information  Exchange  Svstem).  a  computer  mediated 
communication  svstem  designed  bv  "Turofi^.  Hiltz  and  Turofl  wrote 
computerized  conferencing  svsfems  can  be  examples  of  a  GDSS  in  a  distributed 
environment.  For  a  detailed  look  at  the  experiments  utilizing  the  EIES  and 
other  computer-mediated  communication  svstems.  see  Turoff  and  Hiltz  [Ref  5], 
Hiltz  and  TurotTlRef  18],  Kerr  and  Hiltz  [Ref  19],  and  Hiltz  [Ref  27]. 

Mindsight.  developed  bv  Execucom  Svstems  Corporation,  was  installed  using  a 
specially-  designed  U-shaped  conference  table.  The  experiment  conducted  on 
this  svs'tem  involved  senior  executives  using  a  case  studv  based  on  an  actual 
decision-making  situation.   [Ref  2S] 

Lewis  developed,  implemented  and  tested  a  preliminary'  version  of  Facilitator,  a 
microcomputer  based  decision  support  svstem  for  small  groups,  at  the 
Universitv  of  Louisville.  Lewis  used  undergraduate  students  as  subjects  and 
XominarGroup  Technique  to  make  a  comparison  between  the  groups  with  a 
GDSS  tool  and  the  groups  without  the  tool.    [Ref  29] 

Gallupe  used  the  modified  version  of  the  "Bonanza  Business  Case",  a  tvpical 
"trouble-shooting"  tvpe  of  problem,  on  a  svstem  built  at  the  Lniversitv  of 
Minnesota.  His^experiment  also  compared  the  differences  between  the  groups 
using  the  system  and  the  groups  without  the  system.   [Ref  30] 

•  Bui's  Co-oP.  a  Cooperative  Multiple  Criteria  Decision  Support  Svstem,  used  in 
this  experiment,  is  a  ver\'  specialized  GDSS  that  is  still  in  the  process  of 
incorporating  other  basic  GDSS  features.    [Refs.  9.10] 

Although  some  of  these  systems  have  been  built  and  installed/rented  at  the  user 

locations,  most  are  still  being  refined  to  enhance  their  efTectiveness  and  to  make  them 

more  commercially  feasible. 


• 
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III.  ISSUES  IN  GDSS  EXPERIMENTAL  DESIGN 

A.  FRAMEWORK 

Gallupe  discusses  four  specific  issues  that  should  be  carefully  considered  when 
conducting  an  empirical  study  on  the  impact  of  a  GDSS  [Ref.  30].  Our  study  is  based 
on  the  fi-amework  of  these  four  issues.  These  issues  are:  1)  the  nature  of  the  decision 
task  the  group  must  work  on.  2)  the  design  of  a  GDSS,  3)  the  subjects  and  the  setting, 
and  4)  the  dependent  variables  and  their  measurement.  Each  of  these  will  be  discussed 
in  detail  in  this  chapter. 

B.  GROUP  DECISION  TASK 

One  of  the  major  factors  alTecting  group  performance  is  the  type  of  decision  task 
selected  for  the  group  to  work  on  [Refs.  31.32.33].  A  number  of  scholars  have 
identified  various  types  of  tasks  [Refs.  31,34,35,36].  Of  particular  interest  is  McGrath's 
framework  of  group  task,  called  the  Task  Circumplex  [Refs.  37,38].  The  Task 
Circumplex  consists  of  eight  types  of  tasks:  1)  planning,  2)  creativity,  3)  intellective.  4) 
decision-making,  5)  cognitive  conflict,  6)  mixed  motive,  7)  contests;  battles,  competitive, 
and  S)  performance/psycho-motor  tasks. 

These  tasks  can  be  classified  into  four  processes:  generate,  choose,  negotiate,  and 
execute.  See  Figure  3.1  for  clarification.  In  the  figure,  the  horizontal  axis  is  composed 
of  conceptual  and  behavioral  dimensions,  while  the  vertical  axis  consists  of  conflict  and 
cooperation  dimensions. 

The  focus  of  our  research  is  on  the  type  3,  intellective  tasks,  in  Quadrant  II.  the 
choose  process.  We  selected  a  case  study  that  required  participants,  especially  those  in 
the  non-distributed  setting,  to  be  cooperative  and  come  up  with  the  one  correct 
answer. 

Gallupe  also  emphasizes  that  the  group  task  must  possess  the  following 
characteristics: 

•  face  validity  -  the  task  must  appear  to  be  realistic  to  the  participants, 

•  supportability  -  the  task  must  lend  itself  to  support  by  a  GDSS. 

•  content  validity  -  the  task  description  must  be  accurate  and  consistent,  and 

•  external  validity  -  the  task  should  be  generalizable  to  actual  organizational 
decision-makins  situations. 
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Figure  3.1     Group  Task  Circuniplcx. 

Each  of  these  characteristics  was  caretuUy  considered  while  choosing  the  case. 
The  vaUdity  of  each  was  tested  during  the  questionnaire  phase  by  asking  each 
participant  m  the  experiment  to  respond  to  questions  pertaining  to  the  specific 
characteristics  described  above. 

C.       GDSS  DESIGN  ISSUES 

Published  works  on  issues  relating  to  the  design  of  (jDSSs  include:  lluber 
[Rcfs.  21.39].  Bui  [Ref  10],  DcSanctis  and  Gallupc  [Ref  22].  Bui  and  Jarkc  [Rcf  9].  and 
Gallupe  [Ref.  30].  As  mentioned  previously,  very  few  GDSSs  are  commercially 
available.  Those  that  are  available  were  not  designed  using  universal  standards  and 
consist  of  various  hardware  configurations  with  a  variety  of  software  features.  To 
conduct  research  on  the  impact  of  GDSSs.  researchers  are.  therefore,  faced  with  two 
choices:  develop  their  own  or  adapt  an  existing  system  for  their  experiment. 

Before  going  any  further,  the  researchers  must  also  decide  whether  to  tailor  the 
GDSS  to  a  specific  type  of  group  task  or  whether  to  develop  or  adapt  a  system  that 
could  be  used  for  a  variety  of  tasks.    Lewis  decided  on  the  experimental  task  first  and 
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then  developed  the  "Facilitator"  with  features  that  would  support  the  experimental 
group  in  solving  the  task. 

For  our  experiment,  Co-oP,  a  Cooperative  Multiple  Criteria  Decision-making 
tool  that  is  designed  to  facilitate  distributed  decision  making,  was  used. 


Cooperative  sroup  decision-making  is  a  problem  solving  process  in  which  1) 
there  are  two^or  more  persons.  eacIT  characterized  bv  his  or  her  own  perceptions, 
attitudes,  and  personalities.  2)  who  have  recognized  the  existence  of  a  common 
problem  and  j)  attempt  to  use  the  svsteni  to  reach  a  collective  decision. 
[Ref.  9:  p.  S6J 


Co-oP  was  not  designed  for  a  specific  type  of  task.    For  detailed  works  describing  Co- 
oP.  see  [Refs.  9.10]. 

D.       SUBJECTS 

Gallupe  also  mentions  four  concerns  regarding  subjects: 

•  the  number  of  subjects  and;  or  group  size, 

•  the  background  and  skills  of  the  subjects. 

•  the  logistics  of  setting  up  the  experiment,  and 

•  the  type  of  subjects  used. 

Altliough  a  considerable  amount  of  research  has  been  conducted  on  the  influence 
of  group  sizes  [Refs.  32.40],  no  published  works  on  optimal  group  size  for  efTective 
problem  solving  using  computer  and  communication  technologies  are  yet  available. 
Past  researchers  do  indicate  groups  of  size  five  may  be  optimal  for  discussion  groups: 
however,  there  are  no  indications  this  may  also  be  applicable  to  the  computer-mediated 
groups. 

Groups  composed  of  three  members  were  chosen  for  our  experiment  for  the 
following  reasons: 

•  to  facilitate  research  comparison;  previous  experiments  on  the  impact  of  GDSS 
used  groups  of  size  three  [Refs.  1.26.29]. 

•  to  encourage  active  participation  bv  all  group  members  in  the  decision  making 
process,  an'd 

•  limitations  in  the  number  of  available  subjects. 

We  were  ver\'  fortunate  in  the  available  subjects.  They  were  all  from  relatively 
homogeneous  backgrounds  with  at  least  five  years  of  managerial  experience.  For 
further  details,  see  the  section  on  Subjects  in  Chapter  IV. 
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E.  SETTING 

Selecting  the  right  setting  for  the  experiment  is  also  an  important  issue. 
DeSanctis  and  GaUupe  have  proposed  four  scenerios  that  could  be  the  basis  for  a 
number  of  settings  [Ref.  22].  These  scenarios  are:  (1)  a  "decision  room"  where  the 
decision  makers  are  in  a  face-to- face  arrangement  with  or  without  a  computer  terminal 
placed  directly  in  front  of  each  of  them:  (2)  "local  decision  network"  where  the  group 
members  are  in  a  distributed  setting;  (3)  "teleconferencing"  where,  basically,  two 
decision  roomiS  are  established  in  separate  geographical  locations  to  enable  two  groups 
to  come  together  via  video  and  computer  conferencing;  and  (4)  "remote  decision 
making"  in  which  geographically  dispersed  individuals  are  connected  as  a  group  via 
various  communication  technologies. 

Eventually,  the  following  two  scenarios  were  selected  to  test  the  effectiveness  of  a 
GDSS  tool  in  distributed  versus  non-distributed  settings  with  both  groups  using  Co-oP. 

Non-distributed:  Group  members  seated  around  a  table  with  one  terminal 
available  to  them.   Any  inputs  to  the  terminal  were  to  be  based  on  group  consensus. 

Distributed:  Group  members  dispersed  in  time  and  space  with  each  member 
inputting  their  responses  at  their  convenience. 

F.  DEPENDENT  VARIABLES  AND  THEIR  MEASUREMENT 

The  task  selected  to  some  degree  determines  the  type  of  dependent  variables  that 
can  be  measured.  GaUupe  mentions  two  types  of  dependent  variables:  the  "decision 
outcome  measures"  and  the  "decision  process  measures."  The  decision  outcome 
measures,  wiiich  can  be  more  easily  measured,  are  the  decision  quality,  time  for  groups 
to  reach  a  decision  (decision  speed),  and  group  confidence  and  or  satisfaction  with  the 
decision.  Of  secondary'  importance,  due  to  imprecise  methods  of  measurement,  are  the 
"decision  process  measures"  (i.e.,  the  amount  of  system  usage,  the  amount  ot  individual 
participation  by  group  members,  and  the  number  of  issues  considered). 

In  a  number  of  research  studies,  decision  quality  was  measured  by  comparing  the 
test  group's  answers  against  the  answers  provided  by  the  experts  [Refs.  1,5.26.30]. 
Since  the  experts'  choice  was  also  available  with  our  case,  the  authors  decided  to  use 
this  as  the  standard  for  measuring  decision  quality. 

These  four  issues:  group  decision  task,  design  issues,  subjects  and  settings,  and 
variables  and  their  measurements  are  significant  factors  in  any  experimental  research 
on  the  affect  of  a  GDSS  tool  on  group  performance.  This  chapter  discussed  these 
issues  and  their  relevence  to  our  experiment  in  detail. 
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For  the  group  decision  task,  an  intellective  task,  that  should  be  solved  in  a 
cooperative  atmosphere  was  chosen.  A  distributed  versus  non-distributed  setting  was 
selected  to  best  complement  the  software  used.  The  major  variables  tested  were  the 
three  decision  outcome  measures  of  decision  quality,  speed,  and  satisfaction. 
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IV.  DESIGN  OF  AN  EXPERIMENTAL  STUDY 

A.       GROUP  DECISION  TASK 

The  Energy  International  case,  which  was  primarily  designed  for  testing  group 
member  interactions,  was  selected  for  the  experiment  [Ref.  41].  The  experimental 
groups'  task  was  to  select  the  most  suitable  manager  for  a  mining  operations  in  Brazil. 
The  original  case,  which  consisted  of  five  data  sheets  was  consolidated  into  one  page. 
This  was  done  to  expose  features  of  the  GDSS  which  were  specifically  under 
consideration,  and  were  in  keeping  with  adaptive  variables  outlined  in  the  case  study 
itself. 

The  solution  to  the  task  was  assumed  to  be  not  too  intuitively  obvious  at  the 
outset,  but  rather  required  some  degree  of  analysis  and  comparison  of  candidate 
attributes  and  position  requirements.  Additionally,  to  avoid  as  much  as  possible  any 
preconceived  solutions  and  inherent  biases  that  could  influence  subjects'  judgment 
during  the  input  generation  phase,  the  case  study  was  not  available  to  participants 
prior  to  actual  test  time. 

The  decision  task  was  chosen  on  the  basis  of  satisfying  the  essential  criteria  for  a 
valid  case. 

1.  Face  Validity 

This  characteristic  implies  the  task  was  judged  to  be  realistic  to  the 
participants.  Since  officer-students  with  managerial  background  were  used  as  subjects. 
a  case  study  m  management  field  was  chosen.  Specifically,  the  test  involved  a  situation 
that  can  be  encountered  in  real  life.  SulTicient  information  was  provided  to 
participants  via  a  candidate  summary  sheets  to  enable  them  to  select  the  best  candidate 
for  the  job. 

The  condition  that  only  one  best  candidate  can  be  chosen  may  or  may  not  be 
realistic.  However,  for  the  experiment,  this  method  was  proposed  in  order  to  compare 
the  experts'  choice  provided  with  the  case  against  the  results  generated  by  the  groups. 

2.  Supportability 

Supportability  implies  the  task  at  hand  must  lend  itself  to  support  by  a  GDSS. 

This  characteristic  was  analyzed  based  on  the  software  used. 

•      Weishts  that  were  assigned  to  the  criteria  to  select  the  correct  candidate  could 
be  shown  graphically  aiid  numerically. 
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Both  of  these  representations  were  used  during  the  experiment.  Graphical 
representations  proved  useful  during  the  input  generation  phase,  particularly  when 
bargraphs  of  data  just  inputcd  were  shown  relative  to  all  other  inputs.  This  provided 
not  only  a  numerical  reference,  but  also  visual  cues  by  which  members  could  evaluate 
their  progress  and  decide  \vhether  to  proceed  or  make  any  changes. 

Numerical  representations  of  group  members'  inputs  proved  useful  in  the 
result  analysis  phase.  Cardinal  rankings,  ordinal  rankings  and  numerically  represented 
group  results  provided  members  with  feedback  as  to  how  they  solved  the  task  both 
singularly  and  in  relation  to  other  members  of  their  group.  This  inlbrmation  assisted 
the  members  in  assessing  the  decision  making  strategies  employed. 
•        The  case  could  be  best  solved  by  following  a  scries  of  steps. 

This  is  similar  to  following  a  sequence  of  menus  which  lead  the  participant 
through  a  scries  of  steps  toward  the  resolution  of  the  task.  First,  the  candidates  were 
listed  and  then  the  criteria  formulated.  Second,  weights  (between  zero  and  ten)  were 
assigned  to  each  criteria.  Finally,  each  candidate  was  given  specific  points  (between 
zero  and  ten)  depending  on  how  well  he  she  met  the  criteria.  The  case  selected  lent 
itself  well  to  a  weigliing  scheme  as  individuals  were  prompted  to  develop  and  weight 
their  own  criteria,  then  vote  for  candidates  according  to  the  system  they  had  devised. 

3.  Content  \alidity 

The  case  study  used  was  taken  directly  from  a  published  case,  and  as  such, 
content  was  assumed  to  be  valid. 

4.  External  Validity 

Fxternal  validity  implies  the  task  should  appear  to  belong  to  a  general  class  of 
similar  tasks  and  not  represent  one  singularly  unique  problem.  Additionally,  the  task 
should  appear  relevant  to  the  subjects.  For  this  reason,  a  case  that  portrays  a 
snapshot  of  an  actual  management  decision-making  situation  was  chosen. 

B.       THE  PEOPLE 

The  following  people  were  involved  in  the  experiment. 

I.  Chauffeur 

The  chaufTeur  refers  to  the  system  operator  who  acted  as  an  intermediary 
between  group  members  and  the  GDSS  software.  To  avoid  unknown  parameters  and 
unmeasureable  results  associated  with  training  subjects  in  the  use  of  the  GDSS.  inputs 
were  physically  made  by  a  chauffeur.     ChaulFeur  translated  verbal  conunands  into 
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software  commands.  The  presence  of  a  chauffeur  or  intermedian,-  is  well  documented  in 
the  literature  and  can  be  considered  an  important  element  in  the  computer-mediated 
decision-making  process.  Also,  a  chauITer  can  enhance  rather  than  disrupt  the  use  of 
the  computer  based  decision  support  system  [Ref  42]. 

2.  Observer 

The  observer  in  this  experiment  refers  to  the  second  experimenter  who 
provided  the  case  study  and  a  questionnaire  to  individual  group  members,  briefed 
group  members  prior  to  conducting  the  experiment,  noted  clock  times,  and  transcribed 
group  input  responses  to  paper  as  they  were  siir.ultaneously  being  entered  into  the 
system.  The  latter  was  done  as  a  backup  measure.  Interpretation  of  software  and 
prompts  and  or  case  study  elements  were  not  provided  by  either  the  chauffeur  or 
observer  at  any  time.  Once  the  experiment  began,  communications  between  the 
observer;  chaufleur  and  any  individuals  were  restricted  specifically  to  the  input  of  data. 
Likewise,  communications  between  the  experimenters  were  restricted. 

3.  Subjects 

Participants  were  selected  from  the  officer- student  population  of  the  Naval 
Postgraduate  School,  primarily  from  the  Computer  Systems  Vlanagement  curriculum. 
Due  to  the  wide-ranging  backgrounds  of  the  subjects,  no  common  area  of  expertise, 
other  than  general  militan.'  management  experience,  was  evident.  Each  ofilcer- student 
had  a  minimum  of  five  years  of  managerial  experience. 

Members  were  in  the  fifth  quarter  of  a  six  quarter  curriculum.  All  had  been 
exposed  to  various  management  and  computer  related  courses.  As  such,  this  relatively 
homogeneous  group  of  participants,  sharing  similar  management  and  educational 
backgrounds,  eliminated  most  of  the  problems  associated  with  random  subject 
selection.  Moreover,  members  knew  one  another  in  a  manner  suggestive  of  a 
corporate  environment,  where  decision  makers  share  a  similar  culture. 

Groups  were  composed  of  three  members  each.  There  were  six  groups  each  in 
both  the  interactive  and  distributed  modes,  enough  to  get  statistically  significant 
results.  Members  were  encouraged  to  form  their  own  trios  for  nondistributed  modes. 
This  precluded  the  necessity  for  providing  introductory  sessions,  where  individual  group 
members  could  become  familiar  with  one  another  and  with  the  group  decision-making 
process. 
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C.  SETTING 

No  specific  decision  setting  was  designed  for  the  experiment.  A  PC  Computer 
laboraton."  room  in  which  several  IBM  PCs  and  printers  were  available  was  used.  In 
this  experiment  where  each  member  of  the  distributed  group  mode  was  distributed  in 
time  and  space,  access  to  a  networking  facility  was  not  necessar\'.  Instead,  a  chautTeur 
inserted  participants'  inputs  in  a  common  test  disk  that  was  shared  with  other  members 
of  the  group.  Accountability  for  disks  and  disk  storage  thus  became  a  responsibility  of 
the  chaufleur. 

1.  Distributed  mode 

Group  members  were  tested  individually,  at  a  time  most  convenient  for  them. 
Individuals  were  timed  as  to  read  time  and  input  time.  Subjects  were  seated  in 
proximity  to  the  input  terminal  device  and  were  able  to  observe  their  inputs  being 
entered.  These  inputs  were  used  to  form  a  group  result.  Domination  by  any  one 
individual  was  not  possible  in  this  mode. 

2.  Non-distributed  mode 

Group  members  were  tested  as  a  group.  Groups  were  timed  as  to  read  time, 
discussion  time  prior  to  input,  and  input  time.  Group  members  were  seated  in 
proximity  to  the  terminal  in  such  a  way  that  all  had  visual  access  to  the  screen.  Each 
person  was  provided  with  a  complete  case  study  and  was  free  to  ofTer  inputs  at  any 
time  during  the  input  generation  phase. 

D.  PROCESS 

The  software  utilized  for  the  experiment  required  establishment  of  a  group  norm 
and  problem  definition  by  the  chautTeur.  This  was  done  prior  to  presentation  of  the 
case  [0  the  participants.  Selection  and,  or  inclusion  of  criteria  was  a  discretionan.'  issue, 
subject  to  each  participant's  interpretation  of  the  case  and  software. 

Scheduled  groups/individuals  were  assembled.  The  observer  explained  the 
purpose  of  the  exercise,  stressing  its  significance  as  a  group  problem-solving  task  in  a 
cooperative  environment.   The  following  dialogue  ensued: 


You  are  here  today  to  help  us  test  out  a  Group  Decision  Support  System, 
namelv  Co-oP.  We"  are  testing  this  svstem  in  two  different  modes,  a  distributed 
mode  and  a  face-to-face  mode.  In  a  distributed  mode,  three  members  of  a  group, 
distributed  in  time  and  space  input  their  own  individual  responses  to  the  s'vstem 
to  generate  a  group  result.  In  a  non-distributed  mode,  three  members  of  a  group 
reach  a  consensus  prior  to  enterins  their  responses  as  one  input.  Our  goaf  is  to 
compare  the  results  from  these  two  modes.  The  case  we  have  selected  is  a, 
nianasement-tvpe  case;  specifically,  select  the  best  candidate  (rom  a  list  of 
candidates  for'  a  position  described  in  the  case.    The  case  study  is  one  page  in 
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length.  Attached  to  it  are  the  candidate  sunimar\-  sheets.  Feel  free  to  write  on 
anv  sheets  provided  and  take  anv  notes  you  wish'  While  reading  the  case,  think 
about  the  criteria  vou  vourself  would  use  to  select  the  best  candrdate.  Once  vou 
have  finished  readins  the  case  and  ieel  readv  to  proceed,  so  indicate  and  we  will 
move  to  the  input  oT  criteria  phase.  Please 'note,  vou  are  restricted  bv  Co-oP  to 
inputting  onlv  six  major  criteria.  If  vou  need  to  generate  more,  the  'use  of  sub- 
criteria  is  an  option  available  to  vou. ' 


Individuals  were  then  asked  to  read  through  the  case  study  and  candidate 
summarv"  sheets  provided  at  this  time.  Questions  concerning  the  task  were  answered 
by  the  chaufTeur  observer.  However,  this  was  the  only  opportunity  participants  were 
given  to  ask  questions. 

The  observer  began  timing  the  problem  solving  process  o;ice  the  case  study  had 
been  issued.  Time  taken  to  read  and  absorb  the  case  was  considered  as  well  as  total 
input  time  spent  with  the  chauffeur.  The  timing  of  sessions  ended  once  all  inputs  v.'ere 
assembled. 

Group  results  were  provided  to  non-distributed  mode  participants  immediately 
following  the  conclusion  of  the  test.  Test  results  were  explained  to  members  as  needed, 
and  questionnaires  were  distributed  for  completion  prior  to  departure.  Group  results 
for  distributed  mode  participants  were  provided  when  available  and  results  explained. 
Questionnaires  were  distributed  for  immediate  input  and  retrieval,  and  returned  to 
subjects  for  additional  inputs  comments  once  the  final  group  result  became  available. 


V.  EXPERIMENTAL  STUDY 

A.       HYPOTHESES,  QUESTIONNAIRE,  AND  VARIABLES 

The  authors  developed  three  hypotheses  concerning  the  expected  eilects  of  the 
decision  outcome  variables  on  the  two  groups.  The  hypotheses  are: 

•  HI:    Decision  quality  will  be  better  in  a  distributed  mode  than  in  a  face-to-face 
(FTP)  mode. 

•  H2:    Distributed  groups  will  require  less  manhours  to  come  up  with  a  group 
solution. 

•  H3:    There  will  be  no  difference  in  the  decision  satisfaction  level  between  the 
two  groups. 

The  authors,  as  a  matter  of  interest,  also   sought  to  find  the  answers  to  the 

following  questions: 

)1:    Which  group  will  generate  and  meet  the  identified  baseline  criteria  more 


01:    \ 

01  ten? 


•  Q2:   Which  group  will  generate  more  creative  and  original  criteria? 

•  Q3:    Which  group  members  will  be  more  satisfied  with  the  number  o[  criteria 
tney  generatecl? 

•  Q4:    Do  the  participants  prefer  the  non-distributed  setting  or  the  distributed 
setting? 

The   participant   questionnaire   was   used   to   measure   a    number   of  variables. 

Seventeen   questions,   which   involved    selecting   a    number   along   a   scale    that   best 

expressed    the    subjects'    opinions,    were    asked.     Three    questions    required    written 

responses.  Of  the  seventeen  questions,  four  concerning  the  case  study  itself  and  three 

dealing  with  criteria  were  answered  by  both  groups.    Subjects  in  the  distributed  groups 

answered  four  of  the  ten  remaining  questions  while  the  FTP  group  members  answered 

the  rest.  The  questions  were: 

Both  groups: 

1.  Immediately  after  reading  the  case  study,  was  the  correct  candidate  intuitivelv 
obvious  to  you? 

2.  Would  you  say  this  case  studv  can  be  an  example  of  an  actual  decision-making 
situation  in  an  organization? 

3.  Does  this  case  study  appear  to  be  reahstic  to  you? 

4.  Does  this  case  study  lend  itself  to  support  by  Co-oP? 

5.  How  satisfied  are  you  with  the  number  of  criteria  that  you  identified? 

6.  Putting  weights  on  your  criteria  helped  you  in  your  decision-making  process? 

7.  To  what  extent  do  you  feel  Co-oP  helped  you  in  formalizing  your  thoughts? 
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Distributed  Group: 

S.     AH  in  all.  how  good  a  solution  did  you  devise? 

9.     How  satisfied  are  you  with  the  final  result  derived  fi-om  your  individual  inputs? 

10.  This  case  is  would  be  better  solved  in  a  face-to-face  setting  vice  a  distributed 
setting. 

1 1.  How  satisfied  are  you  with  the  group  result? 
FTF  Group: 

12.  How  good  a  solution  did  your  group  devise? 

13.  How   satisfied   are   vou   with    the    decision-makine   process    that   vour    sroup 
underwent  to  develop  the  solutions? 

14.  How  satisfied  are  you  with  the  final  result  derived  fi-om  your  group  inputs? 

15.  Do  you  feel  your  group  accepted  your  contributions  to  solving  the  problem? 

16.  Do  you  think  everv'one  had  an  equal  chance  to  be  heard  in  your  group? 

17.  This  case  is  would  be  better  solved  in  a  distributed  setting  vice  a  face-to-face 
setting. 

Written  comments  from  both  groups  were  elicited  by  the  following: 

18.  What  factor,  if  anv,  would  vou  sav  inhibited  and  or  encouraged  vour  generation 
of  mputs? 

19.  Was  Co-oP  user  friendly? 

20.  In  what  kind  of  decision-making  situation  would  you  find  Co-oP  most  useful? 
The  authors  wished  to  measure  five  variables  from  the  printed  summaries  of  the 

group  inputs  and  solutions:  1)  decision  quality.  2)  decision  speed,  3)  number  of  groups 
meeting  the  baseline  criteria,  4)  number  of  baseline  criteria  generated  by  the  groups, 
and  5)  the  number  of  original/creative  criteria  generated  during  the  group  solution 
process. 

The  variables  to  be  measured  from  the  questionnaire  were:  I)  the  case  selected 
met  the  decision  task  criteria  (i.  e.,  face  validity,  supportability,  content  validity,  and 
external  validity),  2)  satisfaction  with  the  final  results  that  the  individual  group  derived 
from  their  inputs.  3)  satisfaction  with  the  individual  group  solution  when  compared  to 
the  experts'  solution,  4)  satisfaction  with  the  number  of  criteria  generated,  and  5) 
preference  for  either  FTF  or  distributed  settings. 
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Where  relevant,  t-statistic  tests  were  used  to  test  for  the  mean  scores  and  for  the 
significant  difierences  between  the  mean  scores.  For  each  test,  a  0.05  level  of 
significance  was  used  to  decide  whether  or  not  the  null  hypothesis  (Ho)  should  be 
rejected.  Null  hypotheses  were  set  up  where  necessarv'  and  will  be  fiarther  mentioned  as 
they  occur  in  this  chapter.  The  tail  probabilities  or  p-values  (the  probabilities  of  getting 
a  difference  betv/een  the  mean  of  the  sample,  x.  and  the  mean  of  the  population  from 
which  the  sample  came,  u.  is  greater  than  or  equal  to  the  ones  actually  observed)  are 
also  included  where  appropriate.  Since  the  authors  were  testing  the  effect  of  treatments 
in  a  particular  direction,  one-tailed  tests  were  considered  appropriate  for  the  test  of 
mean  scores.  The  consequences  of  a  Type  I  error,  rejecting  the  null  hypothesis  when  it 
is  in  fact  true,  are  thought  to  have  minimum  impact  on  the  data  analysis. 

B.       DECISION  TASK 

In  Chapter  III.  group  decision  task  characteristics  were  described  as  the  primar\' 
factors  driving  the  determination  of  group  performance.  Here  the  first  order  of 
analysis  is  to  determine  if  in  fact  such  characteristics  were  represented  in  this 
experimental  design.  From  Gallupe,  these  characteristics  were:  1)  face  validity.  2) 
supportability,  3)  content  validity,  and  4)  external  validity. 

The  following  text  will  attempt  to  prove  that  each  essential  characteristic  was 
present,  was  well  represented,  and  satisfied  all  requirements  necessan,'  to  ensure  the 
group  decision  task  employed  during  this  experiment  was  valid. 

1.  Face  Validity 

Question  ^^3  was  posed  to  lend  insight  into  face  vahdity.  The  results  indicate 
the  majority  of  subjects  felt  the  case  was  somewhat  realistic.  The  null  hypothesis 
tested  was  the  majority  of  respondents  will  feel  the  case  was  realistic  to  ver}'  realistic. 
The  alternative  hypothesis  was  that  the  subjects  will  choose  unrealistic  to  ver\" 
unrealistic  As  can  be  seen  in  Figure  5.1.  the  null  hypothesis  must  be  rejected. 

On  the  whole,  some  participants  commented  on  the  lack  of  information  they, 
as  managers,  felt  was  essential  in  the  selection  process.  They  believed  personal 
interviews  would  have  been  important  for  determining  the  candidate's  personality, 
general  health,  and  sex;  all  elements  not  as  obvious  in  the  case  itself  {Note:  The 
determination  of  sex  was  possible  from  the  case  materials  provided.  These  comments 
were  made  by  those  failing  to  recognize  this  possibiUty.)  Likewise,  one  participant 
expressed  a  desire  to  evaluate  candidates  along  the  lines  of  'adaptabihty'  and  'growth 
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potential'.  No  information,  much  less  any  valid  means  by  which  to  assess  such 
qualifications,  were  provided  in  the  case  study.  Performance  evaluations  were  also 
lacking  and  their  omission  cited  as  significant. 
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2.  Supportability 

The  null  hypothesis  tested  was  that  respondents  will  choose  verv'  poorly  to 
poorly  to  describe  the  supportabiUty.  The  responses  to  question  #4.  as  shown  in 
Figure  5.1.  rejected  the  null  hypothesis.  The  subjects  indicated  the  case  was 
appropriate  for  support  by  the  GDSS  tool  used. 

3.  Content  Validity 

No  questions  were  posed  to  highlight  any  discrepancies  in  this  area  and  no 
problems  were  cited  by  any  of  the  participants  as  to  the  content  validity.  As  such,  the 
assumption  was  made  that  the  requirement  of  content  validity  was  met. 

4.  E.xternal  Validity 

To  test  this  result  statistically,  rejection  of  the  null  hypothesis  is  in  order.  This 
hypothesis  states  that  respondents  will  choose  strongly  disagree  to  disagree  as  to  how 
well  this  case  represented  an  actual  decision-making  situation.  Figure  5.1  shows  such  a 
rejection  is  in  fact  appropriate.  The  majority  of  subjects  responding  to  the 
questionnaire  chose  agree  to  strongly  agree  to  express  how  they  felt  about  the  case's 
external  validity. 

Based  on  the  above,  the  issue  whether  Energy  International  provided  a  valid 
group  decision  task  can  be  resolved.  Experimental  results  show  the  characteristics  of 
face  validity,  supportability,  content  validity,  and  external  validity,  were  correctly 
represented  in  the  case,  qualifying  it  as  a  valid  group  decision  task  for  testing  purposes. 

C.       DECISION  OUTCOME  MEASURES 

1.  Decision  Quality  and  Baseline  Criteria 

For  this  experiment,  decision  quality  is  equated  with  the  correct  answer  which 
was  based  on  experts'  choice.  Therefore,  the  measurement  of  decision  quality  was 
simply  a  matter  of  determining  which  group  had  a  greater  number  of  correct  answers. 
As  shown  in  Figure  5.2,  four  out  of  six  distributed  groups  came  up  with  the  correct 
selection  vice  two  in  the  FTF  groups. 

The  number  of  baseline  criteria  generated  by  each  group  was  analyzed  using 
the  printouts  from  the  group  sessions.  The  baseline  criteria  that  should  have  been  used 
to  come  up  with  the  correct  solution  were  provided  with  the  case.  The  baseline  criteria 
were:  1)  at  least  35  years  of  age,  2)  appropriate  school,  sex  (where  sex  can  be  derived 
from  information  given  concerning  the  size  of  the  school  attended),  3)  American 
citizen,  4)  Portuguese  language  abihty,  5)  at  least  three  years  of  managerial  experience. 
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and  6)  education  requirements,  i.e.  passing  grades  in  both  seismology  and 
paleontology.  Three  criteria,  namely  age.  citizenship,  and  Portuguese  language  ability, 
were  provided  up  front  in  the  candidate  summan.'  sheets.  Vlanagerial  experience,  sex, 
and  education  criteria  could  be  determined  from  the  information  provided  in  the  case. 
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Figure  5.2    Decision  Quality  and  Baseline  Criteria. 
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To  determine  whether  the  individuals  groups  correctly  generated  and  met  the 
baseline  criteria,  the  rating  given  to  each  candidate  was  carefully  scrutinized.  This  was 
necessary  since  some  individuals  groups  came  up  with  the  right  criteria,  but  incorrectly 
applied  them  to  the  candidates.  Only  those  correctly  applied  were  credited  for  having 
successfully  met  the  baseline  criteria.  Figure  5.2  displays  the  results  of  the  analysis. 

Of  particular  interest  is  the  sex  criterion.  The  results  indicate  that  by  failing  to 
resolve  the  sex  of  the  candidates,  five  participants  in  the  distributed  groups  tied  two 
candidates  for  the  job.  One  was  the  correct  candidate  and  the  other  was  the  only 
female  applicant.  (One  other  participant  tied  the  same  two  candidates,  but  this  was  due 
to  inistakes  made  with  another  criterion).  Three  of  these  individuals  helped  to 
determine  their  groups'  correct  response.  The  FTF  groups  did  not  evidence  the  same 
result  when  they  failed  to  distinguish  the  sex  of  the  candidates. 

As  shown  in  Figure  5.2.  one  FTF  group  (Group  #4)  successfully  generated 
and  met  all  baseline  criteria  for  selecting  a  correct  candidate.  Unfortunately,  the  group 
members  did  not  assign  enough  weight  difierences  between  the  candidates  when  they 
weighed  how  each  candidate  met  the  requirements.  As  a  result,  even  though  they 
identified  all  the  baseline  criteria,  they  were  unable  to  select  the  correct  candidate. 

Secondly,  some  of  the  individuals  and  groups  who  did  not  meet  all  the 
baseline  criteria  were  able  to  choose  the  correct  candidate.  The  weighing  strategy 
employed  overrode  the  baseline  criteria  requirement.  This  was  possible  because  these 
participants  created  large  weight  differences  among  the  candidates,  so  that  the  criteria 
they  did  use  were  useful  selection  measures. 

D.       DECISION  SPEED. 

The  actual  time  taken  by  distributed  and  non-distributed  groups,  while  deriving  a 
solution,  constituted  the  second  area  for  data  analysis.  (See  Figure  5.3)  Recall  from 
Chapter  IV  that  read  time  and  input  time  composed  the  total  task  time  for  distributed 
groups.  Non-distributed  groups  were  measured  using  the  same  technique  with  an 
addition  of  discussion  time  taken  prior  to  reaching  group  consensus. 

The  null  hypothesis  tested  was  that  the  two  samples  will  be  comparable  and  that 
no  statistical  significance  would  exist  between  them.  If  this  had  proven  true,  nothing 
could  have  been  said  regarding  the  elTiciency  of  distributed  versus  non-distributed 
groups,  other  than  they  were  found  to  be  comparable. 
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The  read  times  show  a  significant  difierence  does  exist  between  FTF  and 
distributed  groups.  FTF  groups  spent  less  time  in  the  read  phase  than  did  distributed 
groups.  On  the  other  hand,  FTF  groups  spent  more  time  in  the  input  phase  and. 
therefore,  expended  more  time  overall  deriving  a  solution. 

The  difference  between  distributed  and  non-distributed  total  time  (manminutes) 
occurred  because  in  the  non-distributed  mode  three  individuals  were  required  to  reach  a 
consensus  prior  to  inputting  a  response  into  the  GDSS  and  continuing  on  with  the 
experiment.  Just  how  much  time  was  spent  in  this  FTF  setting,  can  be  seen  by 
comparing  mean  times  between  the  two  modes.  FTF  groups  decision  speed  was 
significantly  slower  than  the  distributed  groups,  indicating  FTF  groups  were  much  less 
efiicient. 

E.       DECISION  SATISFACTION 

Two   satisfaction  variables,   based   on  the  answers  in   the  questioimaire.  were 

measured    to    establish    the    decision    satisfaction    factors:    1)    satisfaction    with    the 

individual, group  solution,  and  2)  satisfaction  with  the  group  results.  The  t-statistical 

test  results  for  both  groups  are  shown  in  Figure  5.4.  The  null  hypotheses  are: 

Hoi:  Members  oi'  both  groups  will  feel  they  have  derived  a  mediocre  to  very 
poor  solution. 

Ho2:  Members  of  both  groups  will  feel  indifferent  to  very  unsatisfied  with  their 
group's  result. 

Ho3:  Distributed  group  members  will  feel  indifferent  to  verv  unsatisfied  with 
their  individual  result. 

Ho4:  There  would  be  no  perception  difference  between  groups  concerning  how 
good  a  solution  they  derived. 

Hoi  There  would  be  no  difference  in  the  satisfaction  level  of  both  groups 
concerning  their  group  result. 

Ho6:    Distributed    group    members    would    feel    equally    satisfied    with    their 
individual  result  and  group  result. 

1.  Perception  About  Individual/ Group  Solution 

The  questions:  "All  in  all.  how  good  a  solution  did  you  devise?"  and  "How 
good  a  solution  did  your  group  devise?"  were  administered  to  individuals  in  the 
distributed  groups  and  FTF  groups  respectively.  These  questions  were  designed  to 
determine  participants'  perceptions  regarding  their  individual  group  solution  when 
compared  to  the  experts'  solution.  The  correct  solution  was  given  to  all  participants 
before  they  answered  the  questionnaire. 
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Read  times 

+  ___!.  _  +  _  _  _  _  _  +  -  _  _  _  _  + PTF 

0.00       5.00      10.00      15.00 

_  _+_  _  _  _  _+_  _  _  _  _+_  _  _  _  _+_  _  _  _  _+ DQ 

4.00  10.00      15.00      20.00      30.00 

Input  times 

+_  _  _  _  _+_  _  _  _  _+_  _  _  _  _+«  _  _  _  _+ FTF 

30.00      35.00      40.00      45.00      50.00 

_    _    _+-    -    -    -    -+-    _    _    _    _+_    _    _    +_    ' _+__DG 

3.00  10.00  15.00  20.00  25.00 

Total  times  ( input  +  read) 

+_  _  _  _  _+_  _  _  _  _+-  -  -  -  -+_  _  _  _  _+ FTF 

35.00      40.00      45.00      50.00      55.00 

+  _  1  _  1  -  +  '-'  '-'  1  1*  1  +  1  _  _■  _  _  + + DQ 

10. 00     20. 00      30. 00      40.  00 

FTF  =  Face  to  face  groups 
DG   =  Distributed  groups 

Difference  is 
T      DF     t. 025   significant? 

read  times  -2.85  21.8  2.078  Yes 
inout  times  +8.54  8.2  2.305  Yes 
total  times   +6.46     8.2    2.306     Yes 


Figure  5.  3    Decision  Speed. 

As  shown  in  Figure  5.4.  both  group  members  felt  rather  strongly  that  they 
produced  a  good  to  very  good  solution  regardless  of  whether  it  agreed  with  the  experts' 
answer.  The  null  hypothesis  (Hoi)  was  firmly  rejected.  Taped  comments  indicate  they 
believe  the  candidate  they  chose  was  either  as  good  as  the  experts'  choice  or  better. 
For  the  FTF  groups,  this  strong  belief  seemed  to  be  based  on  the  fact  candidate 
selection  had  been  via  group  consensus. 

Although  the  FTF  groups'  mean  score  was  higher,  the  difference  between  the 
mean  scores  of  two  settings  was  not  significant  enough  to  state  there  is  a  difference  in 
perception  between  the  two  groups. 
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2.  Satisfaction  uith  Individual/Group  Results 

To  establish  participants'  satisfaction  with  the  final  results  derived  fi-om  their 
inputs,  three  questions  were  asked; 

•  How  satisfied  are  vou  with  the  final  result  derived  from  vour  group  result? 
(DG).  "  -  =       i 

•  How  satisfied  are  you  with  the  group  result?  (DG). 

•  How  satisfied  are  vou  with  the  final  result  derived  fi-om  vour  group  result? 
(FTF).  ■  -  e       1 

The  responses  are  shown  in  Figure  5.4. 

Participants  in  the  distributed  groups  were  satisfied  with  the  final  result 
(i.result)  derived  fi-om  their  individual  inputs.  Yet.  half  of  them  were  less  satisfied  with 
their  group  result  (d. result).  They  believed,  as  individuals,  they  made  a  good  selection, 
but  the  group  as  a  whole  did  not.  On  the  other  hand,  FTF  groups  were  relatively 
satisfied  with  their  group  results  (g. result),  in  spite  of  the  fact  more  of  them  were 
incorrect. 

The  difference  in  satisfaction  level  between  the  two  groups  (d. result; g. result)  is 
not  strong  enough  to  state  clearly  that  members  of  one  group  were  more  satisfied  than 
the  other  about  their  group  result.  However,  within  the  distributed  group,  there  is  a 
significant  difference  in  the  satisfaction  level  between  the  individual  effort  and  group 
elTort  (d. result  i.result). 

F.       OTHER  VARIABLES 

1.  Originality/Creativity 

"Other"  criteria,  in  addition  to  the  baseUne  criteria,  were  analyzed  to  further 
distinguish  between  the  two  groups.  A  criterion  was  measured  as  "other"  when  it  was 
not  applied  correctly  and  when  it  did  not  overlap  with  the  basehne  criteria.  For 
example,  several  individuals  mentioned  sex  as  a  criterion,  but  did  not  get  credit  for  it  as 
a  baseline  criterion  because  they  failed  to  figure  out  the  sex  of  the  candidates.  Instead, 
they  were  credited  for  having  derived  an  "other"  criterion.  Results  are  shown  in  Figure 
5.5. 

The  distribution  of  the  number  of  baseline,  other,  and  total  criteria  is  shown 
in  Figure  5.5.  Compared  to  the  FTF  groups  values,  the  distributed  group  mean  values 
were  lower  for  all  three.  Nevertheless,  the  differences  in  the  mean  values  are  not 
significant  enough  to  reject  the  null  hypothesis  that  there  are  no  differences  between 
the  two  groups. 
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Satisfaction  with  solution 
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Figure  5.4   Decision  Satisfaction. 
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DISTRIBUTED  GROUPS 

Criteria  Group  Numbers 

12       3       4       5       6     Mean 

Baseline    655      544      455      325      546      145      4.  33 
Other  010      102      Oil      042       120      302      1.11 

Total  665      646      466      367      666      447      5.  44 

NON-DISTRIBUTED   GROUPS 

Criteria  Group   Numbers 

12  3  4  5  6  Mean 

Baseline     5      5      4      6      4      6     5. 00 
Other        0      3      3      1      2      4     2.  17 

Total       5      8     7      7      6     10     7.  17 

Difference  is 
T      DF     T. 025     significant? 

DG/FTF  baseline   -1.41    12.5    -2.170       No 
DG/FTF  other      -1.59     7.3    -2.326        No 


Figure  5. 5    Total  Number  of  Criteria. 

2.  Satisfaction  v^lth  the  Number  of  Criteria  Generated 

The  same  question,  "How  satisfied  are  you  with  the  number  of  criteria  that 
you  identified?"  was  given  to  both  groups.  The  null  hypotheses  are: 

1)  no  diflerence  in  satisfaction  level  between  the  two  groups  will  be  evident,  and 

2)  both  groups  will  be  indillerent  to  ver\'  unsatisfied  about  the  number  of  criteria 
they  generated. 

.-Xs  is  evident  in  Figure  5.6,  the  majority  of  both  group  members  were  satisfied 

to  vcr>'  satisfied.  The  distributed  group  members  were  less  unsatisfied  with  the  criteria 

they  generated;  even  though,  the  same  number  of  both  group  members  siatcd  they 

were  either  satisfied  to  very  satisfied.  The  difierence  between  the  satisfaction  level  of 

distributed  groups  and  non-distributed  groups  was  not  significant. 
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Satisfaction  with  number  of  criteria 
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Figure    5. 6 


Criteria. 


3.  Settings 

Given  that  both  groups  1)  used  the  same  computer-mediated  tool,  2)  worked 
on  the  same  intellective  task  requiring  group  members  to  work  in  a  cooperative 
environment,  and  3)  had  a  case  with  an  answer  that  could  be  derived  individually 
without  a  group  efiort,  the  authors  presumed  there  would  be  no  preference  for  either 
FTF  or  distributed  settings.  As  indicated  in  Figure  5.7.  this  was  not  a  correct  premise. 
The  null  hypothesis  was  that  participants  will  have  no  preference  for  either  a  non- 
distributed  setting  or  a  distributed  setting.  Although  for  the  distributed  groups  the 
sample  mean  was  slightly  over  the  population  mean  of  three,  this  was  not  significant 
enough  to  reject  the  first  null  hypothesis.  However,  FTF  group  participants  did 
significantly  prefer  the  non-distributed  setting. 
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Preference  for  a  setting 
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Figure  5. 7    Setting. 

G.   SUMMARY 

The  three  hypotheses,  various  variables,  and  methods  of  analysis  were  presented 
in  this  chapter.  The  authors  considered  validation  of  the  selected  case  a  ven,-  important 
step.  For  this  reason,  a  section  was  devoted  to  the  validity  of  the  task.  Each  of  the 
hypotheses:  decision  quaUty,  decision  speed,  and  decision  satisfaction  were  introduced 
with  their  supporting  data  and  methods  of  measurement.  These  were  deemed  important 
in  determining  the  dilTerences  between  the  two  settings.  "Other"  variables  were  also 
measured  to  further  define  the  differences  between  the  two  groups.  The  analysis  oC  the 
data  shown  here  and  the  conclusions  drawn  from  them  are  presented  in  the  next 
chapter. 
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VI.  CONCLUSIONS 

The  authors  conducted  the  experimental  study  on  the  premise  that  recent 
developments  in  GDSS  tools  would  increase  the  efficiency  and  effectiveness  of  group 
decision-making  and  problem  solving  activities.  Based  on  this  premise,  the  goal  o[  the 
experiment  was  to  determine  in  which  setting,  distributed  or  face-to-face,  a  GDSS  tool 
would  be  more  effective. 

The  framework,  for  the  experiment  was  primarily  based  on  Gallupe's  four  issues: 
the  nature  of  the  group  decision  task,  the  design  of  the  GDSS,  the  subjects  and  setting, 
and  the  measureable  variables.  These  issues  and  their  application  to  the  test  were 
discussed  in  detail  in  Chapters  III  and  IV.  In  Chapter  V,  the  three  major  hypotheses 
and  related  questions  were  presented,  along  with  the  results  from  the  experiment,  to 
either  support  or  disprove  the  hypotheses.  This  chapter  presents  a  comprehensive 
picture  of  the  results. 

A.       TASK 

As  mentioned  previously,  the  decision  task  selected  for  the  groups  strongly 
alTects  the  group  performance.  Using  McGrath's  Task  Circumplex  as  a  model,  we 
chose  an  intellective  task  with  a  correct  answer.  According  to  McGrath  an  intellective 
task  is  generally  conceptual  and  requires  the  cooperation  of  the  group  members  to  be 
solved  successfully. 

The  task  characteristics  of  face  validity,  supportability.  content  validity,  and 
external  vaUdity  were  also  carefully  taken  into  consideration.  The  participants' 
perceptions  of  the  validity  of  these  characteristics  were  extracted  via  the  questionnaire. 
As  shown  below,  the  majority  of  participants  confirmed  the  task  selected  was  realistic, 
supportable  by  Co-oP,  and  relevant. 

1)  The  majority  of  participants  judsed  the  case  study  to  be  realistic  to  ver\' 
realistic. 

2)  The  majority  indicated  the  GDSS  tool  used  supported  the  case  well  to  verv 
well. 

3)  Since  the  information  provided  in  the  case  was  consistent  and  correct,  the 
authors  assumed  content  was  valid. 

4)  The  majoritv  of  responses  ranged  from  agree  to  stronalv  agree  on  external 
validitv. 
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B.       DECISION  OUTCOME  MEASURES 

The  measures  chosen  to  deterniine  the  difTerences  between  the  two  settings  were 
the  decision  outcome  variables  of  decision  quality,  decision  speed,  and  satislaction  with 
the  final  decision.  The  experimental  results  of  these  variables  are  discussed  in  the 
follouing  pages. 

1.  Decision  Quality 

The  number  of  groups  with  the  correct  answer  in  each  setting  was  counted  to 
see  which  mode  was  more  efTective.  Four  out  of  six  distributed  groups  versus  two  out 
of  six  FTF  groups  had  the  correct  solution.  Since  the  distributed  groups  scored  fn'^o 
better.  FTF  groups  were  clearly  less  efiective. 

Although  FTF  groups  generated  more  baseline  criteria,  this  had  no  efTect  on 
the  quality  of  the  final  result.  This  was  basically  due  to  the  weighing  strategy  used  by 
the  groups.  The  group  results  can  be  skewed  depending  on  the  point  spread  ditTerence 
given  to  each  candidate  as  to  how  well  he  she  met  the  criteria.  Small  variations  failed 
to  distinguish  clearly  between  the  candidates. 

2.  Decision  Speed 

The  read  time,  input  time,  and  the  resulting  totals  were  analyzed  to 
demonstrate  that  distributed  groups  require  less  manminutes  to  reach  the  solution. 
Results  are: 

1)  FTF  groups  spent  less  time  in  reading  the  case  study. 

2)  FTF  eroups  spent  more  time  durina  the  interactive  phase.  This  includes 
discussion  time,  prior  to  reaching  a  gro\ip  consensus,  and  actual  input  time. 

3)  FTF  groups  spent  more  total  manminutes  during  the  problem-solving  process. 
On  the  average,  each  individual  member  of  "the  FTF  groups  spent  46.2 
minutes;  whereas,  individual  members  of  distributed  groups  "spent  25.a  minutes 
in  the  process. 

Distributed  groups  were  more  time  efficient  during  the  interactive  phase  and 

during  the  total  decision  making  process.    This  is  to  be  expected,  since  individuals  in 

distributed  groups  could  make  inputs  into  the  final  group  decision  without  having  to 

discuss  and  reach  a  group  consensus. 

3.  Decision  Satisfaction 

Two  variables,  satisfaction  with  individual  group  solutions  and  satisfaction 
with  the  group  results  were  measured  to  compare  the  decision  satisfaction  level 
between  the  two  groups.   Analysis  of  data  indicates: 

1)  Both  group  members  were  satisfied  with  their  individual; group  solution. 

2)  Members  of  distributed  groups  were  satisfied  to  ver>'  satisfied  with  their  final 
individual  result. 
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3)  Onlv  50%  of  distributed  group  members  were  satisfied  with  their  final  croup 
results;  whereas,  67°o  of  the  FTF  group  members  were  satisfied. 

4)  Not  enoueh  difference  is  evident  to   state  clearly  whether  members  of  one 
setting  were  more  satisfied  than  the  members  of  the  other. 

Distributed  groups  had  better  decision  quality  and  faster  decision  speed  than 

the  FTF  groups  during  the  decision  making  process.    The  conclusion  is  that  for  the 

intellective  task  chosen,  subjects  in  the  distributed  groups  generally  utilized  the  GDSS 

tool  more  effectively  and  efiiciently.    However,  the  question  as  to  whether  the  subjects 

ol"  one  group  were  more  satisfied  with  their  solutions  and  final  group  results  than  the 

subjects  of  the  other  cannot  be  answered  conclusively  here. 

C.       OTHER  VARIABLES 

The  GDSS  tool  used  in  the  experiment  required,  for  its  problem  definition  phase, 
two  types  of  inputs  from  the  decision  makers  before  the  problem  solving  phase.  The 
inputs  are  the  alternatives  and  criteria.  The  chauITeur  used  the  data  from  the  candidate 
summary  sheets  to  input  the  list  of  alternatives,  which  were  the  names  of  the 
candidates.  The  group  members  formulated  their  own  criteria  during  interaction  with 
the  chautTeur.  To  gain  insight  into  the  impact  of  the  subjects  generating  their  own 
criteria,  several  questions  were  asked  on  the  questionnaire. 

1.  Originality/Creativity 

The  possibility  that  FTF  groups  would  generate  a  greater  number  of  original 
and  creative  criteria,  due  to  the  exchange  of  ideas  present  in  a  non-distributed  setting, 
was  explored  in  this  section.  The  originality/creativity  variable  was  measured  based  on 
the  total  number  of  criteria  generated  by  each  group.  This  total  included  the  baseline 
criteria  and  any  other  criteria  mentioned  by  the  participants.    The  conclusions  are: 

1)  Xo  determination  can  be  made  as  to  which  group  generated  and  met  the 
baseline  criteria  more  often. 

2)  No  determination  can  be  made  as  to  which  group  formulated  more  creative 
and  original  criteria. 

2.  Satisfaction  with  Criteria  Generated 

Questions  were  also  asked  to  see  how  satisfied  the  participants  were  with  the 
number  of  criteria  they  generated.  No  difTerence  in  the  satisfaction  level  between  the 
two  groups  was  indicated  by  the  data.  Moreover,  a  majority  of  both  group  members 
felt  satisfied  to  very  satisfied  with  the  number  of  criteria  they  developed. 
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3.  Settings 

Since  this  experiment  was  conducted  using  two  distinct  settings,  the 
participants  were  asked  which  setting  they  prelerred.  The  premise  was  that  there 
would  be  no  preference  for  either  setting.  This  held  true  for  the  distributed  groups. 
On  the  other  hand,  FTF  groups  significantly  preferred  the  non-distributed  setting.  This 
preference  may  be  <1i\q  to  the  fact  that  people  do  prefer  face-to-face  communications. 
Yet.  because  no  stcng  preference  for  FTF  setting  was  observed  in  distributed  group 
members,  the  issue  is  not  clear  cut. 

D.       SUMMARY 

The  goal  of  this  experiment  was  to  determine  in  which  setting  a  GDSS  tool 
would  prove  more  useful.  Since  this  is  only  a  preliminary  etTort  into  this  as  yet 
unexplored  area,  no  definite  conclusion  can  be  drawn.  Nevertheless,  two  out  of  the 
three  decision  outcome  measures,  decision  quality  and  decision  speed,  showed 
distributed  in  time  space  setting  was  more  effective  and  efficient.  Better  and  faster 
decisions  can  be  achieved  in  a  distributed  setting.  This  may  be  the  result  of  the 
problems  that  inhibit  the  FTF  interacting  groups  as  mentioned  in  Chapter  L 

The  additional  research  questions  asked  to  gain  insight  into  the  impact  of  a 
GDSS  tool  on  the  decision  making  process  resuhed  in  no  firm  findings.  Specifically, 
no  measurable  difierences  between  the  two  groups  were  observed  in 
creativity  originality  and  satisfaction  with  the  number  of  criteria  generated.  However, 
as  far  as  the  setting  was  concerned,  a  preference  for  FTF  setting  by  those  in  non- 
distributed  setting  was  noted.  Additional  studies  are  recommended  to  further  quantify 
the  results  presented  in  this  paper. 


APPENDIX  A 
ENERGY  INTERNATIONAL  CASE  STUDY 

You  are  one  of  the  General  Mangers  of  Energy  International,  a  young,  medium- 
sized,  growing  organization.  The  prime  mission  of  E.  I.  is  to  locate  and  develop 
mineral  claims  {copper,  uranium,  cobalt,  etc.). 

The  company's  business  has  grown  ver^'  rapidly,  especially  in  South  America, 
where  your  organization  has  been  made  welcome  by  the  government.  In  a  recent 
meeting,  the  board  of  directors  decided  to  develop  a  new  property  near  Fortaleza,  in 
northeastern  Brazil.    This  operation  will  include  both  mining  and  milling  production. 

The  date  is  October  1,  1986.  You  have  come  from  your  respective  plants  in 
dilTerent  locations.  This  is  the  initial  session  of  your  annual  meeting.  Your  first  order 
of  business  today  is  to  select  a  new  General  Manger  for  the  Brazilian  plant  from 
among  the  candidates  on  the  attached  list. 

Fortaleza.  Brazil  has  a  hot  climate,  one  railroad,  a  scheduled  airline,  a  favorable 
balance  of  trade,  a  feudal  attitude  toward  women,  considerable  unemployment,  a  low 
education  level,  a  low  literacy  rate,  and  a  strongly  nationalistic  regim.e. 

The  government  has  ruled  that  the  company  must  employ  Brazilians  in  all  posts 
except  that  of  manager.  It  has  also  installed  an  ofiical  inspector,  who  will  make  a 
monthly  report  which  must  be  countersigned  by  the  General  Manager.  None  of  the 
government  inspectors  and  company's  employees  or  stall  can  read  or  write  any 
language  but  Portuguese. 

The  General  Vlanager  should  have  at  least  three  years  of  experience  as  a 
manager  in  charge  of  a  mining  operation,  be  an  American  citizen,  and  be  a  Fellow  of 
the  Institute  of  Mineralogy. 

Fellowship  in  the  Institute  of  Mineralogy  can  be  obtained  by  those  over  35  years 
of  age  who  have  otherwise  qualified  for  General  Membership  in  the  Institute.  To 
qualify  for  General  Membership,  a  candidate  must  have  a  degree  in  mineralogy  with  a 
passing  grade  in  paleontology  and  seismology. 

There  are  a  number  of  schools  offering  degrees  in  mineralogy.  The  smaller 
universities  require  three,  the  larger  four,  special  subjects  as  a  part  of  their  graduation 
requirements.  The  smallest  is  a  women's  university.  The  largest  univeristy,  the  New 
York  School  of  Mines,  requires  geology,  paleontology,  geophysics,  and  seismology  for 
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graduation.  The  New  Mexico  Institute  of  Earth  Sciences  requires  geology,  seismology, 
and  paleontolgy.  in  addition  to  the  usual  courses.  The  Massachusetts  Institute  of 
Sciences  requires  geology,  seismology,  oceanography,  and  paleontology.  St.  Francis 
L'niversity.  which  is  not  the  smallest  school,  requires  paleontology,  geophysics,  and 
oceanography. 

Using  the  above  information  and  attached  candidate  summan.'  sheets,  develop 
criteria  that  you  would  use  to  select  the  candidate,  and  based  on  them  select  the  best 
candidate  for  the  iob. 
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APPENDIX  B 
QUESTIONNAIRE 


PLEASE  ANSWER  THE  FOLLOWING  QUESTIONS  AFTER  THE  END  OF  YOUR 
SESSION.  WHERE  APPLICABLE,  JUST  CIRCLE  THE  NUMBER  THAT  BEST 
MATCHES  YOUR  RESPONSE.  THANK-YOU  FOR  YOUR  HELP. 

I.  CASE 

1.  IMMEDIATELY  AFTER  READING  THE  CASE  STUDY,  WAS  THE  CORRECT 
CANDIDATE  INTUITIVELY  OBVIOUS  TO  YOU? 

12  3  4  5 

COMPLETELY       SOMEWHAT  SOMEWHAT       COMPLETEL 

UNOBVIOUS        UNOBVIOUS  OBVIOUS  OBVIOUS 

2.  WOULD  YOU  SAY  THIS  CASE  STUDY  CAN  BE  AN  EXAMPLE  OF  AN 
ACTUAL  DECISION  MAKING  SITUATION  IN  AN  ORGANIZATION? 

12  3  4  5 

STRONGLY        DISAGREE  AGREE        STRONGLY 

DISAGREE  AGREE 

3.  DOES  THIS  CASE  STUDY  APPEAR  TO  BE  REALISTIC  TO  YOU? 


■i i i- 


VERY  UNREALISTIC  REALISTIC      VERY 

UNREALISTIC  REALISTIC 

4.  DOES  THIS  CASE  STUDY  LEND  ITSELF  TO  SUPPORT  BY  CO-OP? 

12  3  4  5 

I  _____________  I  _____________  I  ______________  I  ____________  I 

VER^  POORLY     PoipLY  WELL        VERY  WELL 

II.  CRITERIA 

5.  HOW  SATISFIED  ARE  YOU  WITH  THE  NUMBER  OF  CRITERIA  THAT  YOU 
IDENTIFIED? 

12  3  4  5 

VERY         UNSATISFIED  SATISFIED       VERY 

UNSATISFIED  SATISFIED 

6.  PUTTING  WEIGHTS  ON  YOUR  CRITERIA  HELPED  YOU  IN  YOUR 
DECISION  MAKING  PROCESS? 

12  3  4  5 

STRONGLY      DISAGREE  AGREE        STRONGLY 

DISAGREE  AGREE 
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7.  TO  WHAT  EXTENT  DO  YOU  FEEL  CO-OP  HELPED  YOU  IN 
FORMALIZING  YOUR  THOUGHTS? 

12  3  4  5 

VERY  UNHELPFUL  HELPFUL "vERY ' 

UNHELPFUL  HELPFUL 


III.  RESULTS  (DISTRIBUTED  GROUP) 

8.  ALL  IN  ALL,  HOW  GOOD  A  SOLUTION  DID  YOU  DEVISE? 
12  3  4  5 

VERY  POOR       POOR  '  GOOD       VERY ' GOOD 

9.  HOW  SATISFIED  ARE  YOU  WITH  THE  FINAL  RESULT  DERIVED  FROM 
YOUR  INDIVIDUAL  INPUTS? 

12  3  4  5 

VERY  UNSATISFIED         '         SATISFIED        VERY 

UNSATISFIED  SATISFIED 

10.  THIS  CASE  IS/WOULD  BE  BETTER  SOLVED  IN  FACE-TO- FACE 
SETTING  VICE  A  DISTRIBUTED  SETTING. 

12  3  4  5 

STRONGLY       DISAGREE  AGREE       STRONGLY 

DISAGREE  AGREE 

11.  HOW  SATISFIED  ARE  YOU  WITH  THE  GROUP  RESULT?  (ANSWER  AFTER 
RECEIVING  YOUR  GROUP^S  RESULT). 

12  3  4  5 

VERY         UTMSATISFIED  SATISFIED        VERY  ' 

UNSATISFIED  SATISFIED 


IV.  RESULTS  (NON-DISTRIBUTED  GROUP) 

12.  HOW  GOOD  A  SOLUTION  DID  YOUR  GROUP  DEVISE? 
12  3  4  5 

VERY ' POOR      POOR  GOOD         VERY  GOOD 

13.  HOW  SATISFIED  ARE  YOU  WITH  THE  DECISION  MAKING  PROCESS 
THAT  YOUR  GROUP  UNDERWENT  TO  DEVELOP  THE  SOLUTION? 

12  3  4  5 

VERY  UNSATISFIED  SATISFIED        VERY 

U:;SATISFIED  SATISFIED 

14.  HOW  SATISFIED  ARE  YOU  WITH  THE  FINAL  RESULT  DERIVED 
FROM  YOUR  GROUP  INPUTS? 

12  3  4  5 

VERY        UNSATISFIED  SATISFIED       VERY 

UNSATISFIED  SATISFIED 
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15.  DO  YOU  FEEL  YOUR  GROUP  ACCEPTED  YOUR  CONTRIBUTIONS  TO 
SOLVING  THE  PROBLEM? 

12              3  4  5 

COMPLETELY     SOMEWHAT  SOMEWHAT  COMPLETELY 

UNACCEPTED     UNACCEPTED  ACCEPTED  ACCEPTED 

15.  DO  YOU  THINK  EVERYONE  HAD  AN  EQUAL  CHANCE  TO  BE  HEARD 
IN  YOUR  GROUP? 

12              3  4  5 

COMPLETELY     SOMEWHAT  SOMEWHAT  COMPLETELY 

UNEQUAL        UNEQUAL  EQUAL  EQUAL 

17.  THIS  CASE  IS/WOULD  BE  BETTER  SOLVED  IN  A  DISTRIBUTED 
SETTING  VERSUS  FACE-TO-FACE  SETTING. 

12              3  4  5 


JAGREE  AGREE         STRONGI 


STRONGLY       DISAGREE  AGREE         STRONGLY 

DISAGREE  AGREE 


V.  OVERALL  IMPRESSION 

18.  WHAT  FACTOR,  IF  ANY,  WOULD  YOU  SAY  INHIBITED  AND/OR 
ENCOURAGED  YOUR  GENERATION  OF  INPUTS/ 

19.  WAS  CO-OP  USER  FRIENDLY? 

20.  IN  WHAT  KIND  OF  DECISION  MAKING  SITUATION  WOULD  YOU 
FIND  CO-OP  MOST  USEFUL? 

COMMENTS: 


48 


•> 


6. 


LIST  OF  REFERENCES 


Barefoot,  John.  Wigsins.  Beverlv  and  Latane.  Bihb.  "Computer-Mediated 
Communication:  DecT'^ionmakln2 'and  Inlbrmal  Interaction,"  OXR  Techinicat 
Rep'.'yf.  Februarv-  15,  19S5. 

Short,  John,  Williams.  Eden,'n  and  Christie  Bruce.  The  Social  Psychology  of 
Telecommunications,  London: 'John  Wiley  and  Sons.  1976. 

Mintzher2.   Henrv.    The  Xaiure  of  Mana<^erial   Work.  New  York:     Harper  and 
o\v.  19 /J. 

Kotter,  John  P..  The  General  Managers.  New  York:    The  Free  Press.  1982. 

TuroIT.  M.  and  FEltz.  S.  R..  "Computer  Support  for  Group  versus  Individual 
Decisions."  IEEE  'trans,  on  Communicanons.  Vol.  COVI-30,  No.  1,  Januarv  19S2. 
pp.  S2-90. 

Thomas,  R.  C.  and  Burns.  A..  "The  Case  for  Distributed  Decision  Making 
System.'  The  Computer  Journal,  vol.  25,  No.  1,  1982.  pp.  148-152. 

7.  Rathwell.  Margaret  A.  and  Burns,  Alan.  "Information  Svstems  Support  for 
Group  Plannin2  and  Decision- Making  Activities,"  MIS  Quarterly,  September 
19S5.  pp.  255-2T1. 

8.  Scher.  J.  M..  "Distributed  Decision  Support  Svstems  for  Management  and 
Orsanizations."  In  DSS-Sl  Trans.  Execucom  System  Cornoraticni  Technical 
Report,  Eds.  D.  Young  and  P.  G.  W.  Keen,  1981,  pp.  130-140. 

9.  Bui,  Tuns.  X.  and  Jarke.  Matthias.  "Communications  Desisn.  for  Co-oP:  A 
Group  ETecision  Support  Svstem,"  ACM  Transactions  on  V/Tice  Information 
Systems,  Vol.  4,  No.  Z  April  1986,  pp.  81-103. 

10.  Bui,  Tuns  X.  "Co-oP:  A  DSS  for  Cooperative  Vlultiple  Criteria  Group  Decision 
Makin2,"'Ph.D.  Diss.  Dept.  of  Computer  Applications  and  Information  Systems. 
New  York  University,  New  York,  19i)5. 

H.  Bell,  Daniel.  The  Coming  of  Post-Industrial  Society,  New  York:  Basic  Books. 
1971  ^     J 

12.  Mintzberg,  Henrv,  "The  Manaser's  Job:  Folklore  and  Fact,"  Harvard  Business 
Review,  July-Aug'ust  1975,  pp.  49-61. 

13.  Dovle.  M.  and  Strause,  D.,  How  to  Make  Meetings  Work.  Chicaso:  Plavbov 
Press,  1976. 

14.  Van  de  Ven.  Andrew  H..  "An  Applied  Experimental  Test  of  Alternative  Decision 
Making  Processes,"  Kent  State  Lmversity,  1973. 


49 


15.      Van  de  Ven,  Andrew  H.  and  Delbecq.  Andre  L..  "Nominal  Versus  Interaclins 

pp. 


van    uc     V  cu,    .^iiuicw    it.    aiiu    j^tiuti-^.    /\nu.ii-    i^.,  

Group  Processes   for  Committee   Decision- Making  EfTectiveness."    Academy  oj 
Mangemenr  Journal,  }unQ  1971.  pp.  203-212. 


16.  Huber,  Georse  P.,  "The  Nature  and  Desisn  of  Post-Industrial  Organizations," 
Managemeni  Science,  Vol.  30,  No.  8,  Augusf  1984,  pp.  928-951. 

17.  Johansen,  R.,  Vallee.  J.  and  Spansler,  K.  Electronic  Meetings:  Technical 
Alternatives  and  Choices.  Reading,  Mas^:    Addison-Wesley.  1979. 

IS.  Hiltz,  Starr  Roxanne  and  TurofT.  Vlurray,  The  Network  Nation:  Human 
Communication  via  Computer,  Reading,  Mass:'  Addison  Wesley,  1978. 

19.  Kerr.  Elaine  B.  and  Hiltz,  S.  R.,  Computer-Mediated  Communications  Systems, 
New  York:   Academic  Press.  1982. 

20.  Bui.  Tun2  X.  and  Jarke.  Matthias,  "Comniunication  Requirements  for  Group 
Decision  Support  Systems."  Journal  of  Managem^ent  Information  Systems,  Spring 
1986. 

21.  Huber,  Geor2e  P..  "Issues  in  the  Desisn  of  Group  Decision  Support  Svstems," 
MIS  Quarter^',  September  1984.  pp.  195-204. 

22.  DeSanctis,  G.  and  Gallupe.  B.  "Group  Decision  Support  Systems:  a  New- 
Frontier,"  Database,  Winter  1985,  pp.  3-10. 


23. 


Gray,  P.,  "The  SMU  Decision  Room  Project,"  Transactions  of  the  First 
International  Conference  on  Decision  Support  Systems,  (Atlanta,  Ga.).  1981.  pp. 
122-129. 


24.  Sj^rague.  Ralph  H.,  Jr.  and  Carlson,  Eric  D.,  Building  Effective  Decision  Support 
Systems,  Engiewood  Cliifs.  N.  J.:    Prentice-Hall,  1982. 

25.  Grav.  P.,  "Initial  Observations  from  the  Decision  Room  Project,"  Transactions  of 
the  Third  International  Conference  on  Decision  Support  Systems,  (Boston.  Vlass.j. 
1983.  yy         J^  '  \ 

26.  Steeb.  Randall  and  Johnston,  Steven  C.  "A  Computer-Based  Interactive  System 
for  Group  Decisionmakins,"  IEEE  Transactions  on  Svstems.  Man,'  and 
Cybernetics,  Vol.  SMC-11,  N"o.  8,  August  1981,  pp.  544-552.  " 

27.  Hiltz,  S.  R.,  Online  Communities,  Norwood,  N.  J.:   Ablex  Publishing  Corp..  1984. 

28.  Kull.  David  J.,  "Group  Decisions:  Can  Computers  Help?"  Computer  Decisions. 
Vol.  14,  No.  5,  May  1§82,  pp.  70-76,  81-84.  and  160. 

29.  Lewis.  L.  Floyd,  Facilitator:  A  Microcomputer  Decision  Support  Systems  for 
Small  Groups  (1982),  Ann  Arbor.  Mi.:    University  Microfilms  International.  19"S6. 

rt 


50 


j>l.  HacK.man,  J.  R.  and  Morris.  C.  G..  "Group  Tasks.  Group  Interactions  Process 
and  Group  Performance  Eflectiveness:  A  Review  and  Proposes  Intearation."  In 
Advances  in  Experimenial  Social  Psvchologv,  Ed.  L.  Berkowitz.  Vol.  S,^'e\v  York: 
Academic  Press.  19/5. 

32.  Hare.  Paul  A..  Handbook  of  Small  Group  Research.  2nd  Edition.  New  ^'ork:  The 
Free  Press.  1976. 


/"  Small  Group  Dynaniics.  3rd 


33.  Shaw.  M.  E..  Group  Dynamics:     The  Psvchologv  o 
Edition.  New  York:    McGraw-Hill.  1981."'  ^^     ' 

34.  Davis,  J.  H.,  Laughlin.  P.  R.  and  Komorita.  S.  S..  "The  Social  Psvcholoev  of 
Small  Groups:  Cooperative  and  Mixed-Motive  Interaction,"  Annual  Revic',.-  of' 
Psychology.  Vol.  27,  pp.  501-504. 

35.  Lauehlin.  P.  R..  "Social  Combination  Processes  of  Cooperative.  Problem-Solvins 
Groups  as  Verbal  Intellective  Tasks."  In  Progress  in  Social  Psvcholoev,  Ed.  XT. 
Fishbem,  Vol.  1.  Hillsdale.  N.  J.:    Erlbaym.  19§0. 

36.  Shaw.  M.  E..  "Scaling  Group  Tasks:  A  Method  for  Dimensional  Analvsis," 
JSAS  Caralog  of  Selected  Documenis  in  Psychology,  1973,  pp.  143-158. 

37.  McGrath.  Joseph  E..  Groups:  Interaction  and  Performance,  Enclewood  Clifis.  N. 
J.:    Prentice-Hall.  1984.       * 

38.  Lin.  Jimmins  T.  M.,  "The  Impact  of  Computer-Mediated  Communications 
Svstems  on  Interpersonal  Relations  and  Task  Performance."  Diss.  School  of 
Business  Administration.  University  of  Western  Ontario,  1986. 

39.  Huber.  George  P..  "The  Nature  of  Organizational  Decision  Making  and  the 
Design  of  Decision  Support  Systems."  MIS  Quarterly,  June  1981.  pp.  l-TO. 

40.  Hare.  Paul  A..  Creativity  in  Small  Groups,  Beverly  Hills:    Sage  Publications.  1982. 

41.  Pfeilfer.  William  J.  and  Jones.  John  E..  The  1972  Annual  Handbook  for  Group 
Facilitators,  Iowa  City.  Iowa:    University  Associates.  19/2.  pp.  25-35. 

42.  Ginzberg.  Michael  J.,  "Redesign  of  Managerial  Tasks:  A  Requisite  for  Successful 
Decision  Support  Svstems."  t\//S  Quarterly,  Vol.  2.  No.  1,  March  19.8,  pp. 
39-52.  ^^  -  ^  ■ 

43.  Simon,  Herbert  A..  "Applvine  Information  Technologv  to  Organization  Design," 
Public  Administration  Revi'ew.'^lay  Jun  19/3.  pp.  268-T77. 

44.  Jarke,  M.,  Bui.  T.  X.  and  Jelassi.  M.  T..  "Micro-Mainframe  DSS  for  Remote 
\Iulti-Person  Decisions."  In  .\lana<eers.  Micros  and  Mainframes,  Ed.  M.  Jarke. 
John  Wiley  and  Sons  Ltd..  1986,  pp   204-218. 


SI 


INITIAL  DISTRIBUTION  LIST 


No.   Copies 


1.  Defense  Technical  Information  Center  2 
Cameron  Station 

Alexandria.  Virginia   22304-6145 

2.  Librar\-.  Code  0142  2 
Naval Tosteraduate  School 

Monterey,  California   93943-5002 

3.  Curricular  Office.  Code  37  1 
Department  of  Computer  Technology 

Naval  Postsraduate  :ichool 
Monterey.  California   93943-5000 

4.  Tung  X.  Bui.  Code  54BD  1 
Department  of  Administrative  Sciences  , 

Naval  Postgraduate  School 
Monterey,  California   93943-5000 

5.  James  E.  Suchan.  Code  54SA       .  1 
Department  of  Administrative  Sciences 

Naval  Postgraduate  School 
Monterey.  California   93943-5000 

6.  Taracad  R.  Sivasankaran.  Code  54SJ  1 
Department  of  Administrative  Sciences 

Naval  Postgraduate  School 
Monterey.  CaUfornia   93943-5000 

7.  LT  Y.  O.  Fiiol  2 

OfTicer-in-Charge 

Na\'A-  Data  Aut'bmation  Facility  (NAVDAF)  Moffett  Field 

Building  12-2,  Naval  Air  Station 
Moffett^ Field,  California   94035-5021 

8.  LT  M.  A.  Woodburv  2 

Officer-in-Charge 

Na\T  Data  Automation  Facilitv  (NAVDAF)  Lemoore 

Building  773,  Naval  Air  Statiori 

Lemoore,  California   93245-5006 


52 


NAVAi    r-wo-.Ofb.^ij,  ...aTE  SCHOOL 
MONTEREY,  CALIFORNIA  93943-60091 


Thesis 

F427 

c.l 


Fijcl 

Group  DS^^and  decision 
outcpa^T  a  comparative 

idy  in  distributed  ver- 
sus non-distributed  set- 
tings. 


